Response to office action of 07/30/2008 for appl. 10/780,500 

Listing of Claims 

This listing of claims will replace all prior versions of claims and listings 
of claims in the application: 

Please amend Claims 1,11, 22, 32, 36, 38, as shown below. Please 
cancel claim 12. Please add new claims 39-41. 

1 . (currently amended) A computerized method for creating a three dimensional 
model from image panoramas, the method comprising: receiving a plurality of 
image panoramas representing a visual scene and having an object, the object 
occupying a field of view of more than 180 degrees in the panoramas; 
determining a directional vector for each image panorama, the directional 
vector indicating an orientation of the visual scene with respect to a reference 
coordinate system; transforming the image panoramas such that the 
directional vectors are substantially aligned relative to the reference coordinate 
system; aligning the transformed image panoramas to each other; and creating 
a three dimensional model of the visual scene from the transformed and 
aligned image panoramas using the reference coordinate system, wherein 
creating a three dimensional model includes identifying at least one boundary 
of the object and using the identified boundary to associating associate 
geometry information with the object, the geometry information comprising 3-D 
coordinates describing the position and orientation of the object boundary in 
the reference coordinate system. 

2. (previously presented) The method of claim 1 wherein the directional vector 
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is determined based, at least in part, on instructions identifying elements of the 
image panoramas received from a user. 

3. (previously presented) The method of claim 2 wherein the instructions from 
the user identify two or more substantially parallel features in the image 
panoramas. 

4. Cancelled. 

5. (previously presented) The method of claim 2 wherein the instructions from 
the user identify a horizon line of at least one image panorama. 

6. (previously presented) The method of claim 2 wherein the instructions 
comprise the identification of two or more areas of the image panoramas, each 
area containing one or more elements and further comprising automatically 
identifying the two elements contained in the two or more areas. 

7. (original) The method of claim 6 further comprising using edge detection to 
automatically identify the two elements. 

8. (previously presented) The method of claim 1 wherein the image panoramas 
are aligned relative to the reference coordinate system such that the directional 
vector of each panorama is at least substantially parallel to one axis of the 



Page 3 of 19 



Response to office action of 07/30/2008 for appl. 10/780,500 

reference coordinate system. 

9. (previously presented) The method of claim 1 wherein the image panoramas 
are aligned relative to the reference coordinate system such that the directional 
vector of each panorama is at least substantially orthogonal to one axis of the 
reference coordinate system. 

10. (original) The method of claim 1 wherein the image panoramas are aligned 
according to instructions received from a user. 

1 1 . (currently amended) A computerized method of interactively editing objects 
in a panoramic image, the method comprising: receiving an image panorama 
representing a visual scene, the image panorama having an object and a point 
source, the object occupying a field of view of more than 180 degrees in the 
panorama; creating a three dimensional model of the visual scene using 
features of the visual scene and the point source , wherein creating a three 
dimensional model includes identifying at least one boundary of the object and 
using the identified boundary to associate geometry information with the 
object , including associating geometry information with the object , the 
geometry information comprising 3-D coordinates describing the position and 
orientation of the object boundary in a reference coordinate system; receiving 
an edit to the object in the panorama; transforming the edit relative to a 
viewpoint defined by the point source; and projecting the transformed edit onto 
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the object. 

12. Cancelled. 

13. (previously presented) The method of claim 11, further comprising receiving 
an edit to color information associated with the object. 

14. (previously presented) The method of claim 11, further comprising receiving 
an edit to alpha information associated with the object. 

15. (previously presented) The method of claim 1 1, further comprising receiving 
an edit to depth information associated with the object. 

16. (previously presented) The method of claim 11, further comprising receiving 
an edit to geometry information associated with the object. 

17. (previously presented) The method of claim 1 1 further comprising: 
providing a user with an interactive drawing tool that specifies edits for the 
object; and receiving the edits made by the user using the interactive drawing 
tool. 

18. (previously presented) The method of claim 17 wherein the interactive 
drawing tool is one of an extrusion tool, a ground plane tool, a depth chisel tool 
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and a non-uniform rational B-spline tool. 

19. (previously presented) The method of claim 17, wherein the interactive 
drawing tool specifies a selected value for depth for the object. 

20. (previously presented) The method of claim 17, wherein the interactive 
drawing tool incrementally adds to the depth for the object. 

21. (previously presented) The method of claim 17, wherein the interactive 
drawing tool incrementally subtracts from the depth for the object. 

22. (currently amended) A computerized method for projecting texture 
information onto an g e om e tric f e atur e object within an image panorama, the 
method comprising: receiving instructions from a user identifying a three- 
dimensional geometric surface within an image panorama, the image 
panorama containing a- an f e atur e object having one or more textures, the 
feature object occupying a field of view of more than 1 80 degrees in the 
panorama; determining a directional vector from the three-dimensional 
geometric surface; creating a geometric model of the image panorama based at 
least in part on the three-dimensional geometric surface and the directional 
vector, wherein creating a geometric model includes identifying at least one 
boundary of the object and using the identified boundary to associateing 
geometry information with the f e atur e object , the geometry information 
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comprising 3-D coordinates describing the position and orientation of the 
f e atur e object boundary in a reference coordinate system; and applying the one 
or more textures to the feature object in the image panorama based on the 
geometric model. 

23. (original) The method of claim 22 wherein the instructions are received 
using an interactive drawing tool. 

24. (original) The method of claim 22 wherein the three-dimensional geometric 
surface is one of a floor, a wall, or a ceiling. 

25. (original) The method of claim 22 wherein the directional vector is 
orthogonal to the planar surface. 

26. (original) The method of claim 22 wherein the geometric model comprises 
depth information. 

27. (original) The method of claim 22 wherein the texture information 
comprises color information. 

28. (original) The method of claim 22 wherein the texture information 
comprises luminance information. 

29-31 Cancelled. 
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32. (currently amended) A system for creating a three dimensional model from 
a plurality of image panoramas, the system comprising: means for receiving the 
image panoramas representing a visual scene having an object; the object 
occupying a field of view of more than 180 degrees in the panoramas, means 
for allowing a user to interact with the system to determine a directional vector 
for each image panorama; means for aligning the image panoramas relative to 
each other; and means for creating a three dimensional model from the aligned 
panoramas, wherein creating a three dimensional model includes identifying at 
least one boundary of the object and using the identified boundary to associate 
geometry information with the object includes associating geometry information 
with th e obj e ct, the geometry information comprising 3-D coordinates 
describing the position and orientation of the object boundary in a reference 
coordinate system. 

33. (previously presented) The system of claim 32, wherein the input image 
panoramas comprise two-dimensional images. 

34. (previously presented) The system of claim 32, wherein the input image 
panoramas comprise three-dimensional images including geometry 
information. 

35. (original) The system of claim 32 wherein the image panoramas are aligned 
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according to instructions received from a user. 

36. (currently amended) A system for interactively editing objects in a 
panoramic image, the system comprising: a receiver for receiving one or more 
image panoramas representing a visual scene having one or more objects and a 
point source; a modeling module for creating a three dimensional model of the 
visual scene including identifying a selected object in the one or more image 
panoramas, the selected object occupying a field of view of more than 180 
degrees in the panoramas, and wherein creating a three dimensional model 
includes identifying at least one boundary of the object and using the identified 
boundary to associate associating geometry information with the boundary of 
the selected object, the geometry information comprising 3-D coordinates 
describing the position and orientation of the selected object in a reference 
coordinate system; one or more interactive editing tools for providing an edit to 
the selected object; a transformation module for transforming the edit relative 
to a viewpoint defined by the point source; and a rendering module for 
projecting the transformed edit onto the selected object. 

37. (previously presented) The system of claim 36 wherein the one or more 
editing tools comprises at least one of a ground plane tool, an extrusion tool, a 
depth chisel tool, and a non-uniform rational B-spline tool. 
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38. (currently amended) A computerized method for creating a three 
dimensional model from an image panorama, the method comprising: receiving 
an image panorama representing a visual scene and having an object, the 
object occupying a field of view of more than 180 degrees in the panorama; and 
creating a three dimensional model of the visual scene from the image 
panorama using the reference coordinate system, wherein creating a three 
dimensional model includes identifying at least one boundary of the object and 
using the identified boundary to associate includ e s associating geometry 
information with the object, the geometry information comprising 3-D 
coordinates describing the position and orientation of the object boundary in 
the reference coordinate system. 

39. (new) A method according to claim 1, wherein the object is a room and the 
at least one boundary of the object is the intersection of a wall of the room with 
the floor. 

40. (new) A method according to claim 22, wherein the object is a room and the 
at least one boundary of the object is the intersection of a wall of the room with 
the floor. 

41. (new) A method according to claim 38, wherein the object is a room and the 
at least one boundary of the object is the intersection of a wall of the room with 
the floor. 
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